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Abstract 

Given a parametrized family of finite frames, we consider the optimization 
problem of finding the member of this family whose coefficient space most 
closely contains a given data vector. This nonlinear least squares problem 
arises naturally in the context of a certain type of radar system. We derive 
analytic expressions for the first and second partial derivatives of the objective 
function in question, permitting this optimization problem to be efficiently 
solved using Newton's method. We also consider how sensitive the location of 
this minimizer is to noise in the data vector. We further provide conditions 
under which one should expect the minimizer of this objective function to 
be unique. We conclude by discussing a related variational-calculus-based 
approach for solving this frame optimization problem over an interval of time. 

1 Introduction 

In frame theory, the synthesis operator of a finite sequence of vectors {fn}n=i 
R^^ is the operator F -.R^ ~> R^^ Fw := J2n=i w{n)fn- That is, F is an Af x TV 
matrix whose rtth column is /„. Taking the transpose of the synthesis operator 
yields the analysis operator F* : R*^ R^ given by {F*v){n) — The 
sequence {fn}n=i ^ frame for R*^ if there exist frame bounds < A < B < oo 
such that AWvW^ < \\F*v\\'^ < B\\v\\^ for all v G R*^. In this finite-dimensional 
setting, we have that {fn}n=i a frame for R*^ if and only if it spans R^^, which 
is equivalent to having its frame operator FF* be invertible. 

Frame theory was born of the theory of linear least squares: given an overdeter- 
mined system F*v = w, the goal is to reconstruct v from F and w by minimizing 
— lyjp. The minimizers v are characterized as the solutions to the normal 
equations FF*v = Fw, which have a unique solution of u = {FF*)~^ Fw if and 
only if {fn}n=i ^ frame for R*^. The minimum value of \\F*v — w|p is thus: 

min \\F*v - ^ \\F*(FF*)-^Fw - w|P = 11 [l - F* (FF*)-^ F]w\f . (1) 
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In this paper, we focus on a generalization of these ideas that, as detailed below, 
arises naturally in a certain radar problem. In this generalization, we are not given a 
single frame {fn}n=i fo'" but rather a parametrized family of frames {fn{x)}n=i 
for M^^, where the parameter vector x lies in some subset rj of R^. That IS, we 
have an M X synthesis matrix F{x), each of whose entries depend on P real 
parameters. In particular, given F{x) and w, our goal is to solve: 




That is, we want to find the parameters x for which the range of the corresponding 
analysis operator F*(x) is as close as possible to w. In a radar application detailed 
below, the optimal x and v correspond to the unknown position and velocity of a 
target of interest, F{x) has an explicit formula in terms of the locations of a set of 
radar transmitters and receivers, and w is a collection of Doppler measurements; 
solving © corresponds to determining the target's location based on Doppler in- 
formation alone. More generally, solving ([2]) corresponds to finding the particular 
frame from the family of frames {fn{x)}n=i which is most consistent with the mea- 
sured data w. 

The first step in solving the nonlinear least squares problem ([2]) is to recognize 
that for any fixed x d fl, the minimization over v is but a simple linear least squares 
problem. That is, in light of ([1]), solving ^ reduces to minimizing the error function 
E -M-^ [0,oo), 

E{x) -.^ F*{x)[F{x)F*{x)]-^F{x)}w\\^. (3) 

The bulk of this paper is devoted to the study of the minimization of ([3]) . Our 
first priority is to develop a practical method for finding the optimal x. However, 
since F can depend nonlinearly on x, it is unrealistic to expect a nice closed-form 
solution for this optimal x in terms of F and w. We thus settle for a good numerical 
algorithm to iteratively compute x, namely Newton's method. This method relies 
on explicit expressions for the gradient and Hessian of which are presented in 
the following section. In Section 3, we provide some results on the uniqueness of 
the optimal x as well as the sensitivity of ([3|) to noise in w. In the final section, we 
discuss an alternative variational-calculus-based approach for solving a time- varying 
version of ([2]) in which x and w are functions of time and v is the time-derivative of 
X. In the remainder of the introduction, we detail our motivating radar application 
and highlight the relevant literature. 

1.1 A radar application 

In the radar community, the process of determining a target's location is known as 
localization. To be precise, let x : R ^> M^^ denote the trajectory of the target. That 
is, x{t) denotes the location of the target at any given time t, and the dimension 
M is typically either 2 or 3. The goal of a given radar system is to determine x{t) 
by bouncing electromagnetic signals off of the target. 
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Here, we focus on static radar: the target is mobile, but the hardware that trans- 
mits and receives our radar signals is not. More specifically, we consider multistatic 
radar, which makes use of multiple fixed pairs of transmitters and receivers. Let N 
denote the number of these pairs, and let {an}^=i and {bn}n=i in M*^ denote the 
locations of the transmitters and receivers, respectively. A signal broadcast from 
a„, bounced off of the target located at x(t), and then received at 6„ travels a total 
distance of ipn{x{t)), where ipn : K*^ ^ M is the rtth bistatic distance function; 

ipn{x) := \\x - an\\ + \\x - bn\\. (4) 

In the most simple radar systems, each transmitter broadcasts a sequence of 
pulses. In the radar literature, the time lag between the transmitted and received 
pulses is known as the time difference of arrival (TDOA). By multiplying the 
TDOA by the speed of light, one obtains a set of N real-valued measurements 
{yn{t)}^^i which serve as estimates of {ipn{x{t))}^^^. The target's true posi- 
tion x{t) is then known to lie on the intersection of prolate spheroids of the form 

We focus on a different class of radar systems in which each transmitter broad- 
casts a continuous wave of constant frequency. The periodic nature of such signals 
makes it nearly impossible to accurately measure TDOA. Rather, one instead mea- 
sures the frequency difference of arrival (FDOA), namely the change in frequency 
between the transmitted and received wave. This FDOA is proportional to the 
time-derivative of the bistatic distance: 

^fn{x{t)) = {i{t),Vipn{x{t))), 

a fact known as the Doppler effect. 

In short, we focus on FDOA multistatic radar, in which the goal is to determine 
x(t) from a number of FDOA measurements {'Wn{t)}n=i, where each w„(i) should 
equal V</?„(a;(i)) ■x{t), up to measurement error and noise. Here, one's first instinct 
is to try to explicitly solve the following system of N first-order ordinary differential 
equations: 

(i(t),V^„(x(t))) = w„(<), Vn = l,...,iV. (5) 

The problem with this approach is that when M < N , the system ([SJ is overdeter- 
mined and so it is not likely to be solvable. This may be remedied with a standard 
least-squares approach, namely minimizing: 

N 

Y^\{x{t),^^n{xm-WrXt)?. (6) 
n=l 

Indeed, in the final section of this paper, we apply a variational approach to deter- 
mine the Euler-Lagrange equation that any minimizer x of the time-integral of (jH]) 
must satisfy. However, the bulk of this paper is devoted to a more simple approach, 
namely using frame theory to tackle the minimization of ([6]). Here, the key idea is 
to minimize ([6]) individually at each time t. 
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To be precise, let us now assume that FDOA measurements {wn{t)}n=i are 
only available at a single time to. In this setting, the target's velocity at that 
instant is essentially an unknown variable which is independent from its position. 
To simplify notation, we let x := x{to) and v :— i(to) in denote this unknown 
position and velocity, and let w € denote the vector of FDOA measurements 
{wn{to)}n=i- Denoting the vector V(pn{x) as fn(x), the quantity ([S]) at i = to can 
then be rewritten as: 

N 

Y^\{vJn{x))^Wr.\' = \\F*{x)v-wf. 
n=l 

Thus, our problem of minimizing (jG)) for t — to reduces to our frame optimization 
problem ^ in the special case where P — M and the nth frame element fn{x) is 
the gradient of the nth bistatic distance function one may quickly show that 
this gradient is the sum of two unit vectors, namely the vectors pointing to the 
target from the nth transmitter and receiver, respectively: 

/„(x)=V^„(x) = ^-^ + ^-^. (7) 

With perfect FDOA measurements, the target's true location corresponds to the 
global minimizer of the error function ([3]). In the third section, we consider the 
localization error that results from imperfect measurements. We also consider the 
uniqueness of this minimizer: the results suggest that in order to uniquely localize 
a target, one wants the number of FDOA measurements N to be at least 2M. 
This makes intuitive sense since these measurements depend on 2M real-variable 
unknowns: M unknowns for the target's position, and an additional AI unknowns 
for the target's velocity. 

1.2 Relevant literature 

Optimization is a significant tool in frame theory, see [T] [7] for example. The first 
derivatives of certain frame-theoretic quantities are presented in [31 [3]; we build 
on these results here, computing both first and second derivatives of the more 
complicated quantity (jS]). 

The motivating FDOA radar localization problem has long been a subject of 
interest in the radar community. Early work focused on the radar-based tracking 
of transmitters moving in ballistic trajectories [T^], and a formal analysis of the 
underlying theory [llj . A least-squares formulation of this localization problem is 
given in ^ [51 [5]. There, an approximate solution to ^ was found by explicitly 
evaluating the error function ([3]) over a large grid. It has since been suggested that 
the location of aircraft may be determined solely by measuring the Doppler effect 
that their motion induces in the carrier waves of television broadcasts ilO. . 
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2 Newton's method 



Newton's method is a popular algorithm for solving nonlinear least squares prob- 
lems. We use it to minimize our error function E(x) defined in Newton's 
method is an iterative algorithm and will converge to the minimizer at a quadratic 
rate provided E{x) is sufficiently well-behaved and we make a good initial guess 
A formal analysis of when E(x) meets the necessary criteria for convergence is given 
in [8]. In practice, we make our initial guess xq by evaluating E{x) over a grid, and 
choosing the grid point which yields the smallest value. 

Given a current guess Xk, Newton's method approximates E(x) as a paraboloid 
(second-order Taylor multinomial) on a neighborhood of x^ and then moves in the 
direction of that paraboloid's vertex. Explicitly, we let: 

Xk+i Xk - -,[{V^E){xk)]-'{VE){xk), (8) 

where < 7 < 1 is some experimentally chosen step-size parameter and {\7E){x) 
and {V'^E){x) are the gradient and Hessian of ([3]), respectively. We compute this 
gradient and Hessian using a type of differential calculus for matrix- valued functions. 

To be precise, for an open subset 51 of M^, let C^(f2, ^^^) denote the set 
of matrix-valued functions A{x) from il into the set of all A^i x A''2 matrices with 
the property that each of the P partial derivatives of each of the N1N2 entries of 
A(x) exist and is continuous on fl. Here, the partial derivative §^{x) of A{x) with 
respect to the pth variable Xp is obtained by computing the p-partial derivative 
of each entry of A{x) independently. Equivalently, letting {5p}p^i be the identity 
basis for R^, we have: 

8 A 1 

— (x) :^lim-[A(.T + i<5,)-A(x)]. 
One can easily show that this derivative is hnear and has a matrix-product rule: 
— \A^{x)A2{x)\ = -^{x)A2{x)+Ax{x)^{x), 

for all Ax e C^fl.R^^''^^), A2 £ G^fl,R^^''^^). Writing inner products on R^ 
in terms of matrix products, this further yields the inner-product rule: 

d , , - , / dwi \ I dw2 , . 

— {■W1(X),W2[X)} = <^-^(x),W2[x) J + {^l{x), -Q^yX, 

for all wi,W2 € C^(r2,R^). We shall also make use of a type of quotient rule. To 
be precise, if A 6 C^(r2,R^^^), then its entries, and therefore determinant, are 
continuous in x. In particular, if A(xq) is invertible for some xq £ fl, then A{x) 
is also invertible on a neighborhood of xq- Moreover, the cofactor form of A~^{x) 
implies that it is itself continuous in x. As such, 

BA ^ 

-A-\x) — (x)A-^(x) = -\iiRA-\x + tS„)\iiR-\A(x + tSJ-A(x)]A-\x) 
dxp t^Q ^' t^n t 

= lim -\A-^{x + tS„) ~ A-\x)]. 
t->-o t 
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In particular, if A{x) is invertible for all x £ il, then G C^(17,R^^^) with: 

^(x) ^ ~A-\x)^^{x)A~\x). (9) 

These facts in hand, we are ready to compute the partial derivatives of ([3]). Let: 

Il{x) := I - F*{x){F{x)F*{x))~'^F{x). 

It is well known that Tl{x) is the orthogonal projection operator onto the null space 
of F{x). As such, our error function can be simplified as: 

E{x) = ||n(a;)wf = {U{x)w,n{x)w) = {w,U* {x)U{x)w) = {w,U{x)w). 

By the product rule, the pth derivative of E{x) is thus §§-{x) = {w, ^^^w). To 
compute this derivative of 11, we first use © and the product rule to find the 
corresponding partial derivative of [F{x)F* {x)]~^] here, for the sake of succinctness 
and readability, we shorten to simply "F": 

-^{FF*)-^ = (^F* + F^] {FF*r\ (10) 

OXp V OXp OXp ) 

The product rule then gives: 

= -^{FF*)-^F - F*{FF*)''^^ 

^F* + F^ ] (FF*)-^F. 

OXp OXp ) 

Combining the first and fourth terms above, as well as the second and third, gives: 



f)W BF"^ f)F 

— = - [I - F*{FF*)~^F] —{FF*)-^F - F*{FF*)-^—[l - F*{FF*y^F] 

WtXj'p L/iX/p L/iX/p 

= -nn;-nn, (ii) 



where we adopt the notation Hp := F*{FF*) ^§§-- Since 11* = 11 and we are 
working with real- valued inner products, the pth partial derivative of E is thus: 

riF I rtW \ 

d^p " \"'' d^p"^) " """P " ^P^"^^ " "f"""^- ^^^^ 

In light of (jl2p . computing second derivatives of E involves computing the first 
derivatives of Hp. This computation parallels that of PT|) . making renewed use 
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of pUj) . To be precise, for any p,q — 1, . . . , P, 

dXq dXq dXp 



riF* f)F f)'^F 

-{FF*)-'^ + F*{FF*)-' 



/ f)F flF*\ f)F 

_F*{FF*)-U^F* + F^)iFF*y^^ 

\OXq OXq I OXp 

Combining the first and fourth terms above yields 

r)F* FIF 



dXa dXa ^ ' dx, ''•P « P' 



where Uq^p := F*{FF*)-'^^§-§^. Putting {FF*)~'^{FF*) in the first term gives: 

dllp^ dF^ _^ -^dF^ 

dxq dxq^ ' ^ ' dxp P 

= nn;np + n,,p-n^np. (13) 

Having pT|) and ([T^ . we take the gth partial derivative of ([H]): 
2 dXqdXp \ ' dxq I \ ' ^ 

= {w, (nn;n^ + n^^^ - nqUp)nw) + (u;,np(-nn* - n,n)«;) 
= (w, (UqpU + n n^n^n - n^n^n - n^n^n - n^n u*q)w) . 

We now rearrange this statement to better indicate the symmetry between p and q in 
this expression, which is consistent with the symmetry of mixed partial derivatives: 

= 2{w, {UpUq + UqUp)Uw) + 2(nn>,nn» 

- 2{UqUw, UpUw) -2{w, Uq pUw). (14) 
We summarize and (|14l) as the following result: 

Theorem 1. Let il be an open subset ofR^ and let F G C^(il,R*^^^) where the 
columns {fn{x)}n=i of F{x) always form a frame for R*^. For any w G M.^ , the 
first and second partial derivatives of ([3]) are: 

dE 

— ^-2{w,npnw), 

= 2{w, {lipUq + n,np)nw) + 2(n n;^;, n n» 



Q X q dx 



2(n^nu.,npnw) - 2{w,ii.qpTiw), 
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for all p,q — 1, . . . , P, where: 



BF B^F 



U:=I- F*{FF*)-'F, Up := F*{FF*y — , U^^p F* (FF*) . 

(JJUj) (JJbqCJJL'p 

Though the expressions for the gradient and Hessian of E{x) in Theorem [T] 
are comphcated, they are nevertheless straightforward to implement in the New- 
ton's method iteration ([5]). To be precise, given a current guess Xk, our first task 
is to compute ^^{xk) and g!^ (^fc) for all p, g = Calculating these 

derivatives columnwise, this is equivalent to finding f|^(a;fe) and (^fc) for all 

n = 1, . . . , and p,q = 1, . . . , P. For the particular frame ([7]) that arises in FDOA 
multistatic radar, the first derivatives can be found by substituting Xk — a„ and 

~ bn into the following easily-derived formula: 

and summing the results; here, 7r(x) := I — is the projection operator onto 
the orthogonal complement of the line passing through x, where x* denotes the 
transpose of the column vector x. The second derivatives of at Xk can similarly 
be found using the relation: 

fe^R ^ -^[-(-)('5p'5; + v;) + is;nix)s^)i]x. 

With §§-{xk) and gf (xk) in hand for all p, g = 1, . . . , P, our second task in 
any given iteration of'T^Fewton's method is to compute {'VE){xk) and {\7'^E){xk) 
using Theorem [T] we now briefly outline an efficient means for doing so. We be- 
gin by computing the synthesis operator F{xk) ■= [F{xk)F* {xk)\~^ F{xk) of the 
canonical dual frame {/n(a;fe)}^^i. Here, we emphasize that it is not necessary to 
explicitly compute the inverse of the frame operator F{xk)F* (xk)- Rather, the best 
algorithms for numerically computing F{xk), such as Matlab's "pinv" command, 
rely on methods of numerical linear algebra, such as QR factorization. We then 
write the relevant operators in terms of F*[xk)'- 

Il{xk)=l-F*{xk)F{xk), 
Iipixk) = F*ixk)§i;ixk), 

Uq,p{Xk) ^ F*{Xk)Q^§^{Xk), 

and compute, in the following order, the quantities: 

Il{xk)w, {Ilp{xk)Tl{xk)w}p^^, {H*(a;fe)ti;}p^i, 

{n{xk)n;{xk)w}^^,, {u,,p{xkMxk)w}^^,^,. (i5) 

Here, to be efficient, we make use of previous computations and exploit associa- 
tivity to avoid costly matrix-matrix multiplications. For example, to compute 
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Ilp{xk)Tl{xk)w, we take the previously computed N x 1 vector Il{xk)w, multiply 
it by the M x N matrix §§-{xk) and then multiply the resulting M x 1 vector by 
the previously computed N x M matrix F*{xk)', this avoids the O(M^iV) cost of 
computing F*{xk)§^{xk) directly. 

By rearranging some of the operators in Theorem [TJ we see that every entry 
of {VE){xk) and {V^E){xk) can be found by computing inner products of the 
quantities (|15l) . Once this gradient and Hessian are found, we then compute Xk+i 
according to (|8]). By iterating this process, we produce a sequence {a^fcj^Q which 
hopefully converges to the minimizer of E{x). For the FDOA multistatic radar 
problem in particular, this approach seems to work well, often successfully localizing 
the target; see |8j for extensive experimentation on simulated data. 

3 The sensitivity and uniqueness of minimizers 

For any given parameters x il C M^, the quantity E{x), as defined in ((S]), is the 
squared-distance of a given w G from the range of the analysis operator of the 
frame {fn{x)}n=i- In the previous section, we discussed a numerical method for 
minimizing E{x), that is, for finding the particular frame(s) which are most likely 
to have generated a given w. In this section, we consider the uniqueness of such a 
minimizer x, as well as how sensitive it is to changes in w. 

These two issues — sensitivity and uniqueness — are very important in real-world 
applications of this minimization problem. For example, let us recall FDOA multi- 
static radar where P = M, /„(a;) is given by ([7]), and w is a list of Doppler-effect 
measurements, one for each of N distinct pairs of transmitters and receivers. Let xq 
and vo in R*^ denote a target's position and velocity at a given instant, respectively. 
By the nth component of F*{xo)vo G is the instantaneous rate of change 
of the bistatic distance (j4|). In a perfect radar system, the FDOA measurements 
w would equal F*{xo)vq. However, due to various real-world issues, such as noise, 
quantization and an oversimplified physics model, our actual FDOA measurements 
are w = F*{xo)vo + e, where e € R^ is some hopefully small error vector. The 
value of E{x) at the target's true location xq is thus: 

E{xo) = \\{l- F*ixo)[Fixo)F*ixo)]-'Fixo)}{F*{xo)vo + e)f 

= ||{I - F*{xo)[Fixo)F*ixo)]-'F{xo)}ef. (16) 

In particular, if we make the unrealistic assumption that e = 0, then the target's 
true location xg is a global minimizer of E{x), having value zero. This begs the 
question: for s ^ 0, how far away is the minimizer of: 

Eix) := ||{I - F*{x)[F{x)F*{x)]-'F{x)}iF*{xo)vo + e)f (17) 

from xq7 Though a complete answer to this question eludes us, we are nevertheless 
able to make two meaningful points. 

First, since I — F* {xo)[F{xo)F* {xo)]~^ F{xo) is the projection operator onto 
the null space of F{xo) we have E{xo) < ||e|P, with equality precisely when 
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e lies in this null space. Thus, the target must lie somewhere in the level set 
{x e : E{x) < Help}, the size of which is based both on the size of our mea- 
surement error e and the geometry of the surface E{x). Indeed, if E{x) has small 
curvature at its minimizer, then even a slight error in w may result in a large er- 
ror in xq. The expressions for the gradient and Hessian of this surface, given in 
Theorem [Tl are our first steps towards a better understanding of this geometry. 

Second, we note that the minimizer of (I17p need not be unique even when e — Q. 
For example if iV = M, then for any a; G O the frame {/n(a;)}^^]^ is actually a basis 
for M*^; this implies F{x) is invertible and so F*{x)[F{x)F* {x)\~^ F{x) = I. In this 
case, we therefore have that (jl7p is identically zero, meaning every a; is a minimizer. 
This is not good: for FDOA multistatic radar, this means that for any a;, there 
exists a vector v such that a target with that position and velocity would yield the 
measured Doppler vector w = F*{xo)vq + e; it is therefore impossible to localize 
the target. 

In practice, we address this uniqueness problem by adding more measurements. 
Indeed, even when e = 0, the A'^-dimensional measurement vector w — F*{xo)vq 
depends on M -I- P unknowns — the P-dimensional vector xq and the M-dimensional 
vector Wo — and so it's reasonable to believe that we need at least N > M + P in 
order to guarantee that P7| has xq as its unique minimizer. To be precise, note 
that in this £ = case, the set of all minimizers of (IT71) is equal to its set of zeros, 
namely: 

|a;ef7: [l - F* {x)[F{x)F* (x)]-'^ F{x)]w = 0^ (18) 

which contains xq. And though (1181) equals D, for N = M, our numerical experi- 
ments indicate that making Q additional measurements, that is, increasing N 
to M + Q for some Q = 1, . . . , P, shrinks ([T5| down to a (P — Q)-dimensional 
submanifold of ft. In particular, for N > M + P, the set of minimizers (IT51) always 
seems to be discrete. Though we are unable to formally prove that such behavior 
always holds, we are able to give the following partial result, which shows that when 
a certain set of N vectors spans M*^+^, then it is impossible for E{x) to have a 
smooth continuum of minimizers. 

Theorem 2. Let be an open subset ofR^ and let F e Ci(rj, R^^""^), where the 
columns {fnix)}^^i of F{x) always form a frame for M*^. Given some w € M.^ , if 
the vectors: 

{fnix)(BDf„{xr[Fix)F*ix)]-'Fix)w}^^^ (19) 

form a frame for R*^ © R"^ for every x € fl, then the zero set (|18l) of the error 
function ^ cannot contain a nonconstant smooth curve. Here, Dfn(x) denotes the 
M X P Jacobian matrix of fn at x. 

Proof. We prove by contrapositive, assuming the set of zeros of E(x) contains a 
nonconstant smooth curve and proving ([T5| is not always a frame for M*^ © R^. 
To be precise, let x G C^((— ^, (5), M^) be a smooth curve of zeros of E{x) and let 
X :=x(0), u := i(0) ^ 0. 

Adopting the shorthand n(a;) := I - F*{x)[F{x)F*{x)]~^F*{x) of the previous 
section, we have = E{x{t)) = ||n(a;(t))wp for all t G (-5, 6) and so Ii{x(t))w = 
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for all such t. For any n = 1, . . . ,N, letting i/jn K, tpn{x) = {Il{x)w, (5„), we 

therefore have that ijjn{x{t)) = for all t e {—S, 5). By the chain rule, the derivative 
of this equation at t = is thus: 



p—i ^ 



(20) 



where m(p) denotes the pth entry of m £ M^. Now, the product rule gives: 



ix) 



_d_ 

dXr. 



{Xl{x)w,5n) 



9n 

dXr, 



{x)w, 6r 



At this point, a computation (jlip from the previous section gives: 

^(x) = -([n(i)n;(£) + iip{x)n{i)]w, s^)- 

Moreover, since a: is a zero of E{x) we have Il{x)w — 0, and so this simplifies to 

dtpn 



dx. 



-{x) = -{nix)u;ix)w,Sn). 



(21) 



Substituting ^ into (UHl) gives: 

p . p 

= -E(n(i)n;(£)z«,5„)^(p) = -/n(x)E«(p)n;(i)«^,^r 
p— 1 ^ p— 1 

Since n is arbitrary, we have that n(i;) ^^^-^ ■ti(p)n* (x) = 0. This implies that 
Ep=iw(p)n;(i) lies in the null space of n(5:) = I - F* {x){F {x)F {xYY^ F {x) , 
which is known to equal the range (column space) of the analysis operator F*(x). 
In particular, there necessarily exists v G such that: 

F 

F*{x)v — ■u{p)Il*{x)w. 
p=i 

As such, for any n — 1, . . . ,N, 

= /f* (£){)- E "(P)n;(i)u', <5„\ = (z),F(£)5„)-E^(^')(^'np(^)^n)- (22) 
\ p=i ' p=i 

To simplify this statement, note that F{x)5n = fn{x) and so: 

/ OF 
{w,np{x)Sn) = (w,F*{x)[F{x)F*{x)]-^ — {x)Sn 



[F{x)F*{x)]-'F{x)w,^^{x)J 

[F{x)F*{x)]-'F{x)w,Dfn{x)Sp 
{DUxr[F{x)F*ix)]-'F{x)w){p) 
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As such, ([22]) becomes: 

= (i),/„(£))KM - {u,DUxr[F{x)F*{x)]-'Fix)w)RP 
= (« © i-u), U{x) I?/„(£)*[F(£)i^^*(i)]-iF(£)u;)^,,g^jj,. 

In particular, since ii ^ then w © (— u) is a nonzero vector which is orthogonal to: 

fn{x) ® DU{xy[F{x)F*{x)]-^F{x)w 
for all n = 1, . . . , A^, meaning this set of vectors is not a frame for R^^ © M^. □ 

4 A variational approach 

In the previous sections, we studied the problem of minimizing As noted in the 
introduction, such minimization can be used to "solve" an overdetermined system 
of differential equations ([5]) in the least-squares sense of minimizing ([6]) , even when 
the needed data w{t) is only available at a single instant ^o- There, we treated 
the unknown quantities x{to) and x{to) as independent unknowns, which reduces 
the problem of minimizing (|6]) to ([2|) in the special case where P = M. However, 
this simplification comes at a cost: in light of Theorem [5J we expect that at least 
M + P = 2M measurements must be made in order to uniquely determine x(to). 
When only A^ < 2M measurements are available, we are therefore led to consider 
alternative approaches to the minimization of ^ in which x(t) is properly treated 
as a quantity that depends on x{t). 

In particular, in this section, we assume that the data w{t) is given over an 
interval of time [io,ii], and we seek a parameterized curve x(t) that minimizes the 
integral of ([6]) over time, namely: 

/•ti N 

E{x)-^ / ^|(i(t),V<^„(a;(i))) -u;„(i)l'di. 

■^*o n=l 



More formally, letting F*{x) denote the analysis operator of the vectors {/n(a;)}„=i, 
fn{x) V(pn{x) and letting fl C R*^ denote the set of points x at which these 
vectors form a frame for M*^, we seek the minimizer of the functional: 



E : C\[to,ti],n) ^m, E{x):^ \\F*{x{t))±{t) ~ w{t)f At. (23) 



ti 

2. 



In the following result, we use techniques of variational calculus to find the Euler- 
Lagrange equation that any minimizer of (|23p necessarily satisfies. 

Theorems. Let ipn e C^iQ) for each n ^ 1, N , and w e C^{[to,ti],R). Then 
any minimizer x of (j23p necessarily satisfies the Euler- Lagrange equation: 

F{xit)):^^[F*ixit))xit)~wit)]^0, (24) 

for all t G [to, ti] . 
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Proof. We write the functional as: 

J to 

where the integrand function is: 



e 



[to,ti] X X M^^ ^ M, e{t,x,v) = |i-F*(a;)w - w 



Note that since each entry of F*{x) is a first partial derivative of some ipn £ 
we necessarily have that F*{x) is continuously differentiable over ft. This, combined 
with the assumption that w G C^([to,ii],]K) and the fact that e is quadratic in the 
entries of v, implies that e is continuously differentiable over [to,ii] x fi x R*^. 
Classical results from the calculus of variations then tell us that the functional E is 
Frechet-differentiable over C^{[to,ti],n,), and that any minimizer of E necessarily 
satisfies the following system of M Euler-Lagrange equations: 

= ^{t,x{t),x{t))-^^{t,x{t),x{t)), Vm = l,...,M. (25) 

OXm dt dv,n 

For any (i, a:, v) £ [tg, ti] x Q x , the product rule gives the partial derivative of 
e with respect to the mth spatial variable to be: 

{t,x,v)^^\\F*{x)v-w{tW 



dx„i ' ' dx 
d 



dXr 



-{F*{x)v - w{t),F*{x)v - w{t)) 



I d 
= 2( F*{x)v - w{t), [F*{x)v - w{t)] 



^2{F*(x)v-w{t),-^{x)v\ (26) 

Similarly, the partial derivative with respect to the mth momentum variable is: 

Be I B \ 

— (t, x,v)^2{f* ix)v -w{t), — [F* ix)v ~ w{t)] ) 

= 2{F*{x)v-w{t),F*{x)S^). (27) 



For a parameterized curve x e C^{[tQ,ti],n) that minimizes E, evaluating (|26|) 
and (l27t at triples of the form {t,x,v) = {t,x{t),x{t)) and then substituting the 
results into ([25|) gives: 

= (F*{x{t))x{t) - w{t), ^{x{t))x{t) 

-^(F*{x{t))x{t)-w{t),F*{x{t))S^), Vm-l,...,Af. (28) 
at 
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To simplify, note that the product rule gives: 
^^{F*{x{t))x{t) - w{t),F*{x{t))dm) = (^^^[F*{x{t))x{t) - w{t)],F*{x{t))5„ 

+ (^F*{x{t))x{t)-w{t),^^F*{x{t))6.„ 

Substituting this expression into (l28l) and collecting common terms gives: 

/ BF* rl 

= ( F*{x{t))x{t) - w{t), ^{x{t))x{t) ~ ^F*{x{t))S„ 
\ oxm dr 

-l^^^[F*{x{t))x{t)-w{t)],F*{x{t))5.„,^, Vm = l,...,M. (29) 

At this point, it suffices for us to show that: 

d B F* 

-F*{x{t))6„,^^{x{t))x{t). (30) 
Indeed, substituting (ISH]) into (1^ yields: 

0=(^^^[F*{xit))xit)~wit)],F*{ximJ^ 
- (^F{x{t))^^[F*{x{t))x{t) - w{t)],d„,y Vm = 1, , 

which is equivalent to our claim To show that the vector equation ([50)1 holds, 
note that the nth coordinate of the left-hand side is: 

^^F*ixit))S^,6„'^ = A(F*(x(t)),5„,<5„) = A(5„,/„(x(t))). 

Now recall that the nth frame vector fn{x) is defined as the gradient of the nth 
scalar- valued function ipn{x). As such, its mth entry is f^(a^), implying: 

^ ig^Wt)) ^ (v^) (.(,))), (31) 

Now, since (pn G C^(r2) by assumption, we know its second partial derivatives are 
symmetric, implying: 

Using this fact in ([?T|) yields: 

which, since it holds for all n = 1, . . . , A^, implies our claim (jSU)) . □ 
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We conclude by noting that Theorem [3] does not give an exphcit algorithm for 
finding the minimizer of (j23p . Rather, it provides a first-order, nonlinear differen- 
tial equation that any minimizer must satisfy. In practice, one way to make use of 
this result is to guess a large number of initial position and velocity combinations 
(x(to),i{to)); for each combination, we can then use a numerical differential equa- 
tion solver to extrapolate the target's trajectory x : [to,ti] — > according to ([21)) : 
we then choose the particular curve x whose corresponding value E{x) is minimal. 
We leave further developments of these ideas for future research. 
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